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A METHOD AND A DEVICE FOR PROCESSING BIT SYMBOLS GENERATED 
BY A DATA SOURCE; A COMPUTER READABLE MEDIUM; A COMPUTER 
PROGRAM ELEMENT ™ ~ ~ 



5 Background of the Invention 

Embedded coding has generated tremendous interest in video, 
image and audio processing. This is because embedded 
coding allows the encoder to terminate the encoding process 

10 at any point to meet a pre-determined target bit rate. 

Furthermore, the decoder can truncate the bit-stream at any 
point and is still able to obtain a reasonable good quality 
of the decoded video, image or audio. In other words, an 
ideal embedded coding system is able to provide rate- 

15 distortion optimized truncated bit-streams, making it an 
ideal coding tool for building systems with Fine 
Granularity Scalability (FGS) . 

A popular method to implement an embedded coding system is 
20 by sequential bit-plane coding (BPC) due to its simplicity. 
In BPC, input data vectors from a data source are 
represented in bit-planes, and the bit-planes are then 
encoded sequentially, starting from the most significant 
bit-plane which represents the most significant bits (MSB) 
25 of the input data vectors, to the least significant; bit- 
plane which represents the least significant bits (LSB) of 
the input data vectors. In addition to its structural 
simplicity, such encoding sequence from the MSB to the LSB 
of the input data vectors satisfies a principle of the 
30 embedded coding process as disclosed in [1], wherein bits 
affecting the quality of the video/image /audio data most 
should be encoded first. 
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Generally, implementing a bit-plane coding that gives an 
optimized value of the rate-distortion curve is extremely 
complex and requires high computational resources. This is 
because for general data sources, there exists statistical 
dependencies among bit-planes as well as among data 
samples. In order to capture such dependencies, an entropy 
coder has to employ a frequency table with a large number 
of entries, which does not only increase the complexity of 
the entropy coder but may also result in large modeling 
cost [2] that eventually degrades the coding performance. 
Therefore, most practical implementations of bit-plane 
coding usually adopt a compromised approach to reduce the 
computational complexities, which unfortunately, result in 
performance degradation. 

Hence, it is desirable to have a bit-plane coding process 
which gives an optimized value of the rate-distortion 
curve, which is of a low computational complexity, and yet 
does not result in substantial degradation in performance. 

Summary of the Invention 

It is an object of the invention to provide an embedded 
coding scheme which is of low computational complexity, but 
have performance which is comparable to any of the systems 
mentioned above. 

The object is achieved by the features of the independent 
claims. Additional features result from the dependent 
claims . 
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The present invention relates to a method for processing 
bit symbols generated by a data source, in particular a 
video, still image or audio source, comprising the steps of 
5 constructing a plurality of bit-planes using the bit 
symbols generated by the data source, each bit-plane 
comprising a plurality of bit-plane symbols, scanning the 
bit-plane symbols of each bit-plane to generate a binary 
string of bit-plane symbols, and encoding the binary string 
10 of the bit-plane symbols using a statistical model, wherein 
the statistical model is based on statistical properties of 
a Laplacian probability distribution function which 
characterizes the data source. 

15 The bit symbols generated by the data source, which 

comprises a plurality of input data vectors, are first 
arranged in such a manner so that a plurality of bit-planes 
are formed. Each bit-plane comprises a plurality of bit- 
plane symbols which corresponds to each bit symbol of the 

20 data source. 

The data source may refer to any kind of data signal which 
can be captured by a capturing device for further 
processing. Specifically, the data source in this 
25 specification refers to a video, a still image or an audio 
source which can be captured by a video recorder, camera 
and microphone, respectively, for further processing. 



30 



Starting from a bit-plane, preferably the bit-plane 
containing the MSB of the input data vectors, all the bit- 
plane symbols are scanned to select bit-plane symbols 
according to a certain manner in order to generate a binary 
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string of bit-plane symbols. The binary string of bit- 
plane symbols generated by the scanning process then are 
encoded using a statistical model. The statistical model 
is generated based on statistical properties of a Laplacian 
probability distribution function (pdf ) of the data source, 
in particular a video/image/audio source. 

The advantage of using a statistical model which is based 
on the statistical properties of a Laplacian pdf for 
encoding the binary string of bit-plane symbols is that the 
computational complexity of the encoding process based on 
this kind of statistical model is very low. When the 
statistical model is based on the statistical properties of 
a general pdf, an extremely large probability table is 
required to be maintained in the encoder, which is 
unsuitable for applications with limited computational 
resources and storage capacity. In order to overcome this 
problem, most BPC schemes according to the state of the art 
only entropy encode a limited subset of bit-plane symbols 
that have very skew distribution, resulting in substantial 
loss of coding efficiency. 

By exploiting statistical properties of a Laplacian pdf of 
the data source according to the invention, the need for 
such a large probability table is eliminated, resulting in 
a substantial reduction in computational complexity and yet 
without any substantial loss of quality. 

The encoding method according to the invention uses an 
entropy encoding process, which is a form of data 
compression method based on statistical models. 
Preferably, an arithmetic encoder is used as an entropy 
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encoder for encoding the binary string of bit-plane symbols 
generated by the scanning process* 

Arithmetic encoding, an entropy encoding process, is 
5 preferred since it provides good compression ratio. 

A Laplacian pdf can be defined using the following 
function: 



parameter, of the Laplacian pdf. 

15 According to an embodiment of the invention, the above 
equation of the Laplacian pdf is used to determine the 
probability assignment to each of the bit-plane symbols . 
The determined probability assignment is subsequently used 
to determine the statistical model for encoding the binary 

20 string of bit-plane symbols. 

Specifically, the probability assignment to each of the 
bit-plane symbol is determined using the following 
equation: 



10 /(*) = 




wherein o is the standard deviation, or the distribution 




, j = M-1, M-2, ... 



wherein 
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Pj is the probability assignment to the bit-plane symbol, 
and j represents the bit-plane. 

The above probability assignment equation is obtained from 
the Laplacian pdf , and is used to determine the probability 
of each bit-plane symbol. Such probability or statistical 
information of the data source is subsequently used by the 
encoder, in particular the arithmetic encoder, for encoding 
the binary string of bit-plane symbols. 

Due to the statistical properties of the Laplacian pdf, the 
complexity of determining the probability distribution of 
each bit-plane is tremendously reduced. 

In another embodiment where the standard deviation, a, is 
not known, the probability assignment to each bit-plane 
symbol is determined based on the knowledge from encoding 
the previous bit-plane symbols. 

Such an adaptive process is useful in practical 
applications when knowledge of the statistical properties 
of the data source is not known, or when the data source is 
non-stationary. In such cases, the statistical properties 
of the data source are determined based on information 
obtained from previously encoded bit-plane symbols. 

Specifically, the probability assignment to each bit-plane 
symbol in this embodiment is given by the following 
equation: 
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p 




wherein 



Pj is the probability assignment to the bit-plane symbol,. 
N a is the number of bit-plane symbols coded until the end 
the previous bit-plane, 

N is the number of bit-plane symbols coded in the current 
bit-plane symbol, 

Pj Na is the estimation of Pj after observing M a bit-plane 
symbols, 

P/ SL is the maximum likelihood estimation of Pj for the 
current bit-plane and is defined by 



wherein b±,j is the bit-plane symbol. 

Preferably, the estimation of Pj from previous coded bit 
planes, Pj Na , is estimated by updating from the previous 
bit-plane using the following equation: 



N-N u 




N-N Q 





wherein Pfe is the estimation of Pj from the previous bit- 



planq . 
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In another embodiment of the invention, the method for 
processing bit symbols generated by a data source further 
comprises the steps of determining an optimal bit-plane 
(referred to as lazy plane) from the input data vector to 
be coded, determining a probability assignment to each bit 
plane based on its relation with the lazy plane, wherein 
the probability assignment to the bit-plane is used as the 
statistical model for encoding the binary string of bit- 
plane symbols. 

In this embodiment, the computational complexity of the 
encoding process is further reduced since the probability 
assignment to each bit-plane is explicitly determined by a 
relationship with the lazy plane. 

Firstly, the lazy plane is selected from the plurality of 
bit-planes. The lazy plane is represented by an integer, 
L, which satisfies the following inequality: 

**** *o«t> 2L 



wherein 

(f> is defined by ~j 9 3nC * 



A J4 

0 is defined as 0=e Va 



The above decision rule actually partitions the support of 
the distribution parameter, a, into disjointed regions, and 
the lazy plane corresponding to each partitioned region is 
specified so that it satisfies the above inequality. 
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After the lazy plane is determined according to the 
invention, the probability assignment to each bit-plane is 
determined. The probability assignment to each bit-plane 
5 is based on its relationship with respect to the optimal 
bit-plane as given by the equation: 



20 



Of -J 



1 • r 



1 + 2 2 " 
1 . . 



10 wherein 

Qj is the probability assignment to the j 1 * bit-plane. 

Alternatively, when the length and the absolute sum of the 
input data vectors of the data source are known, the lazy 
15 plane may be determined using the following equation: 

L = min{z, GZ 1 2 L+1 N *a\ 

wherein 

N is the length of the input data vector, and 
A is the absolute sum of the input data vector. 



The determining of the optimal bit-plane may be implemented 
by a slight modification of the algorithm as disclosed in 
25 [3] to extend the range of order £ to a negative integer. 

In another alternative embodiment, the probability 
assignment to each bit-plane which is based on its 
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relationship with respect to the lazy plane may be 
determined using the equation: 



of- 



2 i-L 



2 J<L 



In this embodiment, the encoder may be implemented using 
the skew coder which is disclosed in [4] . 



As mentioned, the two alternative embodiments described 
10 above has the advantage of further reducing the 

computational complexity of encoding the binary string of 
bit-plane symbols. 

Furthermore, a method is provided for processing the 
15 encoded binary string of bit-plane symbols to generate an 
output data representing the data source, comprising the 
steps of decoding the encoded binary string of bit-plane 
symbols to generate a further binary string of bit-plane 
symbols so that a plurality of bit-planes comprising the 
20 bit-plane symbols can be reconstructed. The plurality of 

bit-planes are reconstructed with the probability assigned 
by a further statistical model, and hence the output data 
representing the input data vectors can be reconstructed. 
The statistical model is based on a Laplacian probability 
25 distribution function which characterizes the bit-plane 
symbols. 

The statistical model generated from the decoding process 
of the binary string of the bit-plane symbols is identical 
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to the statistical model which is used for the encoding 
process. In other words, the probability assignment, Pj or 
Qj, used for forming the statistical model in the encoding 
process is re-generated in the decoding process. 



5 



The plurality of bit-planes are thus reconstructed using 
the identical statistical model used in the encoding 
process, resulting in the reconstructed output data to be 
exactly identical to the original data source up to the 



10 bit-plane where the encoded binary string of bit-plane 
symbols is terminated by the decoder. 

Furthermore, an optimal mean square error (MSE) 
reconstruction of the source vectors is produced with the 
15 probability assigned by that statistical model. 

Specifically, the probability assignment Pj is used to form 
the statistical model in the encoding process, and the data 
source is reconstructed using the following equation: 



20 




wherein 



x t is the re-constructed data source, and 



s± is a sign symbol of x t . 

25 T is the bit-plane the encoded binary string of bit-pl 
symbols is terminated 
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Similarly, when the probability assignment Qj is used to 
form the statistical model in the encoding process, the 
data source is reconstructed using the following equation: 

As can be seen from above, the second summation ^Qj^ S i 

used for enhancing the quality of the re-generated data 
source, which can be stopped once a desired quality is 
10 achieved. 

The described embodiments of the invention apply not only 
to the method, but also to a device, a computer readable 
medium and a computer program. 

15 

Brief Description of the Figures 

Figure 1 shows a general structure of a video/image/audio 
coding system. 

20 

Figure 2 shows a general structure of a bit-plane coding 
system. 

Figure 3 shows a modified structure of the bit-plane coding 
25 according to an embodiment of the invention. 

Detailed Description of the Preferred Embodiment of the 
Invention 
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Fig.l shows a general structure of a video/image/audio 
coding system 100. A data source, in particular video, 
still image or audio source, is received by a capturing 
device 101. The capturing device 101 may be a video 
recorder, a camera or a microphone for capturing different 
types of data source. The captured data is first converted 
into a digital signal by an Analog-to-Digital (A/D) 
converter 102 for further processing. 

The bit symbols of the data source generated in the A/D 
converter are received by a bit-plane coding system 103 
(which will be described in detail later) comprising an 
encoder unit 104 and a decoder unit 105. The encoder unit 
104 encodes the bit symbols and transmits the encoded 
symbols over a channel to the decoder unit 105. 

The decoder unit 105 decodes the encoded symbols and sends 
the decoded symbols to an output device 107, for example a 
digital television or digital camera, to be displayed. If 
the output device 107 is an analog device (for example an 
audio speaker), a Digital^to-Analog (D/A) converter 106 may 
be used to convert the decoded symbols to an analog signal 
before outputting them to the output device 107. 

Fig. 2 shows a general structure of a bit-plane coding 
system 103, comprising an encoder unit 104 and a decoder 
unit 105. The encoder unit 104 further comprises a bit- 
plane construction and scanning unit 110, a first 
statistical model unit 111 and an entropy encoder 112. The 
decoder unit 105 further comprises an entropy decoder 122, 
a second statistical model unit 121 and a bit-plane 
reconstruction unit 120. 



WO 2004/042933 



PCT/SG2002/000248 



14 



At the start of the encoding process, the bit symbols 130 
are received by the bit-plane construction and scanning 
unit 110. The bit symbols 130 comprises a plurality of 
input data vectors which can be represented as 

X - {X lf X 2 , — f X k } (1 ) 

for a ^-dimensional input data vector, wherein 
x± is extracted from an independent and identical 
distributed (i.i.d.) random source of some alphabet A C SR. 

x± may also be represented in binary form as 

Xi ={2s t -l\Yb gtr 2S , 1=1 , ,k (2 ) 

wherein sx is the sign symbol which is expressed as 



ri x, * o 
[o ^<o 



(3) 



and b±,j is the amplitude symbol wherein bi,j e {0,1}. The 
binary representation of x± is also normalized as integer M 
satisfies the following inequality: 



(4) 



2 M ~ l <; max|jcJ}< 2 M ,i = \„.,k 



When each input data vector of the bit symbols 130 is 
received by the bit-plane construction and scanning unit 
110, the input data vector is decomposed into its sign 
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symbol s± and amplitude symbols b±,j. The sign and amplitude 
symbols of the input data vectors are arranged to form a 
plurality of bit-planes, with each bit-plane containing a 
sign symbol s± or an amplitude symbol bi,j from each input 
5 data vector. Generally, the amplitude symbols b irj 

corresponding to the most significant bit (MSB) of the 
input data vectors are arranged in a first bit-plane, and 
the amplitude symbols b irj of the second MSB are arranged in 
a second bit-plane, and so on. , The sign symbols s± of the 
10 input data vectors are also arranged in another separate 

bit-plane. All the sign and amplitude symbols of the bit- 
planes are referred to as bit-plane symbols. 

Once the bit-planes are constructed, all the bit-plane 
15 symbols contained in the bit-planes are scanned, starting 
from the bit-plane containing the MSB of the input data 
vectors. The scanning process is to select the bit-plane 
symbols to form a binary string of bit-plane symbols 131. 
One possible scanning process is summarized in the 
20 following steps: 



1. Start scanning from the bit-plane j=M-l containing the 
MSB of input data vectors, 

2. Select the amplitude symbols b±,j with the 

25 corresponding amplitude symbols of all the previous 

bit-planes being "0": jbi,„-i= b ± , M . 2 =..= b ifj+1 =0. 

3. When the amplitude symbol b±,j is "1'.', the sign symbol 
si is also selected. Steps 2) and 3) are known as the 
significance pass. 

30 4. Select the amplitude symbols b±,j which are not 

selected in the significance pass. This step is known 
as the refinement pass. 
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5. Progress to the next bit-plane j-I. 

The above steps are iterated until a certain terminating 
criterion, for example when a pre-defined bit-rate is met 
or a pre-defined rate-distortion constrain has been 
reached. 

Once the binary string of bit-plane symbols 131 is 
generated by the above scanning process, it is further 
encoded or compressed in the entropy encoder 112. 
Statistical properties 132 of the bit-plane symbols of the 
data source 130 is used in the statistical model 111 to 
provide the probability assignment 133 which is used for 
encoding the binary string of bit-plane symbols 131 in the 
entropy encoder 112. 

The encoded data 134 from the entropy encoder 112 is 
transmitted over a channel, which is subsequently received 
and decoded by the entropy decoder 122. The channel may be 
an Internet network, a Wide Area Network (WAN) , or a 
wireless communication network. 

The entropy decoder 122 receives and decodes the encoded 
data 134 into a binary string of bit-plane symbols 135. 
Theoretically, the binary string of bit-plane symbols 135 
generated by the entropy decoder 122 is identical to the 
binary string of bit-plane symbols 131. 

The statistics of the bit-planes 137 is used by the 
statistical model 121 to generate the probability 
assignment 136, which is identical to 133 so that the bit- 
plane symbols can be correctly decoded. The bit-plane 



WO 2004/042933 



PCT/SG2002/000248 



17 



symbols 135 are then used by the bit-plane reconstruction 
unit 120 to reconstruct the bit-planes to generate an 
output data 138 representing the bit symbols 130 of the 
data source. 

In case that optimal MSE reconstruction is desired, the 
probability assignment 136 is also used by 120 to reproduc 
the output data 138. 



10 It should be noted that, in order to obtain an optimal 

compression of the binary string of bit-plane symbols 131 
of a data source having a general probability distribution 
function, the number of bits required by the entropy coder 
112 for encoding the bit-plane symbols is given by 

15 -log 2 Pr (s if b± fM - lr ^) , wherein the probability Pr (s±,bx fM - lr ...) 
can be expressed as: 

Pr (s±,b±, M -i,».,b±, M -j) = Pr(s±)Pr(b i , M - 1 \s i ).„.Pr(b i , M - :l \s i ,b i , M - 
i,~.,b±,M-j+i) 

20 

wherein 

Pr(b±,M-j\s±,bi rM - 1 ,.„,b±, M -j+ 1 ) denotes the conditional 
probability of b±, M -j on previously coded bit-planes. 

25 In practice, implementing such an entropy encoder for 

encoding all the bit-plane symbols of the data source will 
generally require a frequency/probability table with a 
large number of entries. For encoding at high bit-rates, 
the number of entries to be maintained in such a frequency 

30 table is extremely large and hence is not practical, 
especially in systems with limited computational and 
storage capabilities. In addition, it may introduce 
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substantial modeling cost [2] for an adaptive setting for 
data sources with unknown distribution. Therefore, a 
simplified approach is adopted in most practical systems 
wherein only bit-plane symbols with very skew distribution 
(those symbols scanned in the significance pass) are 
encoded by the entropy encoder, as described in [5] and 
[6] . 

According to the invention for bit-plane coding, the 
properties of a Laplacian probability distribution function 
(pdf) which is inherent in most data sources, especially in 
video, still image and audio sources, is used for encoding 
of the data source by the entropy encoder 112. 

Specifically, the statistical model 111 uses the 
statistical properties of the Laplacian pdf of the data 
source to generate the probability assignment 133 for 
encoding the binary string of bit-plane symbols 132. The 
Laplacian pdf of the data source can be expressed using the 
following equation: 




wherein a is the standard deviation or distribution 
parameter of the Laplacian pdf. 

It can be readily verified from (6) that the bit-plane 
symbols of the Laplacian source has the following 
independency properties: 
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Pj = Pr(b±,j=l) = Pr (bi,j=l \ sirb!,^,^,^,^!) (7) 

Pr(b irj =0) - Pr(b±,j=0\s i ,b i , M - 1 ,...,b i , j+1 ) = I - Pj (8) 

Pr(s±=l) = Pr(s±=0) =0.5 ( 9) 

wherein the probability assignment for the entropy coder 
for each bit-plane j is given by (7) - (9) . 

From (6), Pj can be calculated as 



, j - M-l, M-2, ... (io) 



When the distribution parameter a (or the standard 
deviation) of the Laplacian pdf is known, Pj can be 
determined directly using equation (10) . 

When Pj is determined, the probability of each bit-plane 
symbols can be determined using equations (7) to (9) and 
such statistical information of the data source is used by 
the entropy encoder 112 for encoding the binary string of 
the bit-plane symbols 131. 

It can be seen from above that by using the statistical 
properties of the Laplacian pdf of the data source, the 
maintenance of a large frequency table according to the 
prior art is not needed, and hence the encoding process of 
the binary string 131 by the entropy encoder 112 is greatly 
simplified. 
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In a further embodiment of the invention, the probability 
assignment Pj to each bit-plane symbol determined in 
equation (10) is used to regenerate the binary bit-plane 
symbols 135, which is received by the bit-plane 
reconstruction unit 120 to generate the output data 138 
representing the bit symbols of the data source 130. 

Specifically, if optimal MSE reconstruction is needed, upon 
decoding up to bit-plane T of the encoded data 134 by the 
entropy decoder 122, the optimal reproduction of the output 
data 138 according to the invention is given by the 
following equation: 

x, = (2s, J;&,,2' + J\P,2' j 

T 

The first summation 2!& lV 2' is the reconstruction of the 

bit-plane symbols, and the second summation "9^2' is the 

interpolation of the corresponding bit-plane symbols on the 
Laplacian pdf . 

The second summation may be terminated when a pre-defined 
criteria is satisfied, for example when a desired quality 
of the data source is obtained. 

In an alternative embodiment of the invention, the 
probability assignment Pj to the bit-plane symbols is 
determined adaptively based on the knowledge from encoding 
previous bit-plane symbols. This adaptive bit-plane coding 



WO 2004/042933 



PCT/SG2002/000248 



21 



5 



10 



20 



25 



(ABPC) process is useful when the distribution parameter a 
of the Laplacian pdf is not known as in the case of most 
practical situations. 

Starting from Lidston' s Law of success when given a string 
of * distinct symbols, if the symbol occurred n, times 
in the past n instances, the probability estimation of i" 
symbol occurring is estimated using the following equation : 

Pra\{ ni },n) = (m + X)/(n + kX) 

\ 1 2 ) 



Wherein A is a positive parameter. it can be seen that 
equation (12) is an interpolation of the maximum likelihood 
estimate ni /n and the uniform prior 1/k by rewriting 
15 equation (12) as: 

Pr(l\{ ni },n) - /t (ni/n) + (1 - u) (1/k) (13) 



with the substitution 
M = n/(n + kX) . 

Applying equation (13) to the present embodiment of the 
invention gives 



(14) 



1 hi I M I i ( 15) 



wherein 



N a is the number of bit-plane symbols coded until the end of 
30 the previous bit-plane, 
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N is the number of bit-plane symbols coded in the current 
bit-plane symbol, 

Pj Na is the estimation of Pj after observing N a bit-plane 
symbols, 

5 Pj^ is the maximum likelihood estimation of Pj for the 
current bit-plane, and 

jli gives the interpolation between these two probability 
estimation. Preferably, fi Is given by 



10 Lt - 1 - (N a /N) (16) 

Since the maximum likelihood estimation of Pj for N symbols 
b±,j at j th bit-plane is given by: 



15 P > N= N ' (17 > 



therefore, and Pj ML can be defined by 



20 



pML 



N-N a 



• -jtn: <is) 

Preferably, from equation (10), Pj Na can be updated from the 
previous bit-plane P*; using the following equation: 



^ ■ l (19, 



25 
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The embodiments described so far relate to finding the 
probability assignment to every bit-plane symbol of the 
data source. 

In another embodiment of the invention, a "two-pass" 
approach is adopted where the probability assignment to 
every bit-plane to be used by the entropy encoder for 
encoding the binary string of bit-plane symbols is 
determined from the statistics of the data vector to be 
coded. 

In this embodiment, an optimal bit-plane is selected from 
the plurality of discrete bit-planes, which is referred to 
as the lazy plane. Information on the selected lazy plane 
is transmitted by the encoder unit 104 to the decoder unit 
105, so that the encoded data 134 can be decoded correctly. 

Fig. 3 shows a modified general structure of the bit-plane 
coding system according to this embodiment of the 
invention. 

The information on the selected lazy plane which is 
contained in the encoded data 134 is received by the 
statistical model unit 121. The statistical model unit 121 
generates the probability assignment 136 to be received by 
the entropy decoder 122, so that the bit-plane symbols of 
the encoded data 134 can be correctly decoded. The decoded 
bit-plane symbols 135 are then received by the bit-plane 
reconstruction unit 12 0 to reconstruct the bit-planes to 
generate the output data 138 representing the bit symbols 
130 of the data source. 
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Consider a code family given by the following equation: 
C - {& \ L e Z} ( 2i) 
5 wherein 

G 2 * denotes the bit-plane symbols of the data source, and 
L is an integer which denotes the lazy plane. 

The probability assignment according to this embodiment of 
10 the invention is given by: 



25 



1 . r 

1 (22) 
2 J<L 



wherein is the probability assignment to the j** bit- 

15 plane which follows the probability updating rule as 

defined by equation (19) for bit-planes i > L and enters a 
"Lazy mode" (since the encoding for probability assignment 
of H can be achieved by outputting the input symbols 
directly to the encoded binary string) for bit-planes i < 
20 L. Such a code family C may be called Bit-Plane Golomb 
Code (BPGC) . 

The lazy plane L can be obtained by finding an integer 
value for L which best satisfies the following inequality: 



^0<^ L (23) 



wherein 
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10 



15 



20 



L is the integer representing the optimal bit-plane, 



When sufficient statistics such as the length and the 
absolute sum of the input data vectors are known, the 
decision rule of (23) may be further simplified to 

L = min^L GZ 1 2 L *N *a\ { 2 5 

wherein 

N is the length of the input data vector, and 
A is the absolute sum of the input data vector. 

The selection process as described in this embodiment may 
be implemented using the algorithm described by [3] . When 
the algorithm in [3] is used to determine the value of L, 
only positive integer range of L can be determined. To 
extend the range of order L to negative integer, the 
algorithm described by [3] is modified. 

Specifically, the modified algorithm of [3] is given as 

if (N<=A) 

for (L=l; (N«(L+1))<A; L++) 

else 

for (L=-l; (N»{-L))>=A; L — ) 




and 



0 is defined as 




(24) 
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When the lazy plane L is determined, the probability 
assignment to the bit-plane to be used for encoding of the 
binary string of bit-plane symbols by the entropy encoder 
can be determined. 

In another alternative embodiment of the invention, the 
probability assignment to each bit-plane based on its 
relationship with respect to the optimal bit-plane is 
determined using the following equation: 



:>j<L 



(26) 



wherein 

L is the integer representing the optimal bit-plane as can 
be determined by (23) 



In this embodiment, the probability assignment given by 
(2 6) hence enable the use of the skew coder as described in 
[4] as an extremely low complexity implementation of the 
entropy coder instead of a general arithmetic coder. The 
skew coder of [4] is able to simplify the entropy encoding 
process to only a small number of bit-shift and addition 
operations by restricting the probability interval width 
corresponding to the least probable symbol (LPS) to the 
powers of 2. In addition, the skew coder of [4] retains a 
unique simplicity in implementing the acceleration 
technique [6] in coding a run of successive most probable 
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symbols (MPS) that is typical in coding bit-planes with 
high probability skew. 

It should be noted that in all the described embodiments of 
the invention, except the embodiment for generating the 
BPSC, arithmetic encoder should preferably be used as the 
entropy encoder. 

In a further embodiment of both the embodiments of the 
invention mentioned above, the probability assignment Q L . to 
each bit-plane symbol determined in equations (22) or (26) 
is used to generate the output data 138 by the bit-plane 
reconstruction unit 120, representing the bit symbols 130 
of the data source. 

Specifically, upon decoding up to a bit-plane T of the 
transmitted data 134 by the entropy decoder 122, the 
optimal reproduction of the output data 138 according to 
the invention is given by the following equation: 

T 

Similarly to equation (11), the first summation Yb if 2 s is 

the reconstruction of the bit-plane symbols, and the second 

summation ^Qf 2 * is the interpolation of the corresponding 

bit-plane symbol of the output data 138 on the Laplacian 
pdf . 



(27) 
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The second summation may be terminated when a pre-defined 
criteria is satisfied, for example when a desired quality 
of the data source is obtained. 



5 The described embodiments of the invention apply not only 
to a method but also to a device, a computer readable 
medium and a computer program. 

While the embodiments of the invention have been described, 
10 they are merely illustrative of the principles of the 

invention. Other embodiments and configurations may be 
devised without departing from the spirit of the invention 
and the scope of the appended claims. 
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